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Abstract. In the present paper, wc consider the hnear autoregressive model 
in R, 

^fc,n = fn^fc,,i-i + 5fc, A; = 0, 1, ■ ■ ■ ,n, n>l 
where 0n G [0,1) is unknown, (5fc)fcgz is a sequence of centered i.i.d. r.v. 
valued in R representing the noise. When 9„ — > 1, the moderate deviations 
principle for empirical covariance is discussed and as statistical applications 
we provide the moderate deviation estimates of the least square and the Yule- 
Walker estimators of the parameter 6n ■ 



1. Introduction 

There is a great deal of the econometric hterature of the last 20 years which has 
focused on the issue of testing for the unit root hypothesis in economic time series. 
Regression asymptotics with roots at or near unity have played an important role 
in time series econometrics. This has been typically done by using autoregressive 
models with fixed coefficients and then testing for the autoregressive parameter 
being equal to 1 [5,6]. More recently, some attention has been dedicated to random 
coefficient autoregressive models. This way of handling the data allows for large 
shocks in the dynamic structure of the model, and also for some flexibility in the 
features of the volatility of the series, which are not available in fixed coefficient 
autoregressive models. 

In the present paper, we consider the following linear autoregressive model in R, 

Xk,n^dnXk-l,n+^k, fc = 0, 1, • • • , n, n>l (1.1) 

where 0„ € 9 C M (the space of parameter) is unknown, {^k)k£Z is a sequence of 
centered i.i.d. r.v. valued in R representing the noise and which is independent of 
Xo,„, and (Xfc^„)o<fc<n is observed. For every ti > 0, assume that the law of Xo.n is 
invariant (or equivalently {Xk^n)o<k<n is stationary), it is easy to see a stationary 
solution to (1.1), which is given by 



p=0 



only if \9n\ < 1. 
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It is not difBcult to see that the hnear autoregressive model (1.1) is a special 
moving average process. A general moving average process is given by 

+00 +00 

j=-oo i=-oo 

where (^n)nez is i.i.d., (a„)„gz is a sequence of real numbers such that 



E 



n6Z 



an? < 00. 



There are two important issues for the model (1.1): (1) the estimate of the 
covariance Cov{Xo,n, Xi^n) ■= E(Xo,„ — EXo,„)(X;^„ — EXi^„); (2) the estimate of 
On- The most natural estimator of Cov{Xo^n, Xi,n) (/ > 0) is given by the empirical 
covariance (with the given sample (^fc,n)o<fe<n-i) 

n — l 

C^l,n ^ 7 2^ -'^A:+i,n-^fc,n (1-2) 

n — i ^ — ' 

k=l 

and for estimating the following two estimators are widely used: 
(i) Least Square Estimator: 



(ii) Yule- Walker Estimator: 



J2k=l -^k-i 

l^k=0 ^k,n 



(1.3) 



(1.4) 



In this paper, we are concerned with the moderate deviations principle of the 
covariance estimation C;*„ and the parameter estimators 9n,9n for the linear au- 
toregressive model under the case: 6'„ e [0, 1) and 6n 1. 

The study on large deviations and moderate deviation are relatively recent and 
these works concentrate almost on the case of the fixed autoregressive coefRcient 
0„ = 0e (-l,l),i.e., 

X„ = (?X„_i+e„, n>0. (1.5) 
For the Gaussian case (i.e., the noise ^ is assumed Gaussian), this subject is 
opened by Donsker and Varadhan [8] who proved the lcvel-3 large deviation prin- 
ciple (the definition of large deviations of levcl-3 could be found in [9]) for gen- 
eral stationary Gaussian processes under the continuity of the spectral function. 
Bryc and Dembo [1] proved for the first the large and moderate deviation prin- 
ciples for the empirical variance Cq,j(= t^^^ X]fe=i ''^fe) 6ven for general station- 
ary Gaussian processes. Bercu et al. [2] proved the large deviation principle for 
^ini— Y^k=i ^k+i^k), I > (which is much more delicate than Cq_„) and for 

For the Non-Gaussian case, Wu [17] first extended Donsker- Varadhan's theorem 
on large deviations of level-3 from stationary Gaussian processes to general moving 
average processes under the Gaussian integrability condition on the driven variable 
^. Djellout et al. [7] established, in the one-dimensional case, moderate deviation 
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principle for non-linear funetionals of general moving average processes covering 
the case of C;*„ and for the periodogram, but under the assumption that the law 
of the driven random variable ^ satisfies the log-Sobolev inequality, stronger than 
the Gaussian integrability in [17]. 

For the case of Hilbertian autoregressive model with driven random variable ^ 
satisfying the Gaussian integrability condition, in which {£,k,Xi;}kez take values 
in some separable Hilbert space H, Mas and Menneteau [11] established large and 
moderate deviation for the empirical mean Xn = X]fc=i -^k: and moderate devi- 
ation for the empirical variance matrix i X]fe=i -^k ® Xk, where x (E) y {x,y £ H) 
denotes the linear operator from H to H, 

X ® y : h £ H ^ {x, h)y, 

extending the result of Bryc-Dembo [1] from R'^ to H, and especially from Gaussian 
case to general sub-Gaussian case. Furthermore, Menneteau [12] obtained some 
laws of the iterated logarithm in Hilbertian autoregressive models for the empirical 
covariance ^ J2k=i Xk- Recently, Miao and Shen [14] obtained a moderate 

deviations principle for C* ^ of the autoregressive process (1.5), which removed the 
assumption of log-Sobolev inequality on the driven variable in [7] , for the particular 
but important auto-regression model. In addition, they provided the moderate 
deviation estimates of the least squares and the Yule- Walker estimators of the 
unknown parameter of an autoregressive process. In [15], the author also considered 
the discounted large deviation principle for the autoregressive processes (1.5). 

Our main purpose in the paper is to extend the moderate deviations principle 
for the empirical covariance from the case On = to the case 0„ — > 1. The method 
of proof relies mainly on a moderate deviation for triangular arrays of finitely- 
dependent sequences and the exponential approximation. This paper is organized 
as follows. The next section is devoted to the descriptions of our main results and 
their statistical applications. In Section 3, we give some preparations and develop a 
new moderate deviation for m-dependent sequence with unbounded m. The proofs 
of main results are obtained in the remaining sections. 



2. Main results 



2.1. Assumptions. Let {C„}nez be a sequence of real valued centered i.i.d. ran- 
dom variables, and suppose that the following conditions hold: 

(1) the imknown parameter On satisfies On G [0, 1), On — > 1; 

(2) E^o = and satisfies the Gaussian integrability condition, i.e., there 
exists a > 0; such that 

Ee"«o < oo; 

(3) the moderate deviation scale (6„) is a sequence of positive numbers satis- 
fying 

On — OO, > OO. 

On 

Here we need to note that the condition (3) implies 

lim n{l — On) = OO, and — > oo. 

n^oo On 
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2.2. Moderate deviations principle. The following is our main theorem. 

Theorem 2.1. Assume that the conditions (1), (2) and (3) are satisfied and let 
M be a non-negative integer, then for all r > 0, when < I < M , we have 



lim 7^ log I 



(1-^,1) 



\^l,n ~ ll^Q*," I 



> r = - 



2\2 • 



(2.1) 



Remark 2.1. Since M is fixed and I is finite, then the form (2.1) is equivalent to 



lim log I 



(2.2) 



In the process of proving Theorem 2.1, we often use the form (2.2) in order to avoid 
extra explanation. 



The following result supplies a moderate deviation for the linear combination 
of the empirical covariance. For the case that the unknown parameter On is fixed 
{On ~ 0), we can succeed in obtaining the moderate deviation of the parameter 
estimators 9m0n by utilizing the following result directly. 

Theorem 2.2. Under the conditions in Theorem 2.1, for any n and < I < M , let 
{ai n} be a sequences of real numbers with lim a;.„ = ai, and assume that ai ^ 

' n— f oo ■ 

for some < I < M . Then for any r > 0, we have 



1™ l^^°g^ 



bn 



M 



whe 



1=0 



> r \ = -- 



2E2 



Remark 2.2. Under the conditions of Theorem 2.2, if j=o ^ then we have 



lim T^-logl 



bn 



M 



Y^aiACln-^Cln) 



1=0 



> r 



2\2 ■ 



In particular, Theorem 2.1 holds, if there exists some < ^ < M, such that 

fl, k = l 



0, k^l 



2.3. Applications. In the subsection, we provide a statistical application. More 
precisely, we shall apply the method of proving Theorem 2.1 and 2.2 to the least 
squares estimator 6"^ and the Yule- Walker estimator 6'„. 

Proposition 2.1. Assume that the conditions (1), (2) and (3) are satisfied, then 
for any r > Q, we have 



and 



lim — log I 



YH\()n - On\ > 



r 
~2 
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Remark 2.3. A recent paper by Giraitis and Phillips [10] (also see, Phillips and 
Magdalinos [16]), established the asymptotic distribution of the least square esti- 
mator On in a stationary first-order AR model when n(l — On) — > oo, i.e., 

(l-02)-l/2^1/2(4_0„)4 7V(O,l). 

Remark 2.4. For the case of = 9 <E (—1,1), Djcllout ct al. [7] derived the 
moderate deviations of 9n and 0n as a consequence of their general results on the 
moderate deviation of moving average processes, but with an extra and strong con- 
dition that the law of .Jo satisfies a log-Sobolev inequality (though their method go 
far beyond the regression model). In [14], the authors gave the moderate deviations 
of On and where they removed the assumption of log-Sobolev inequality on the 
driven variable. 



3. Some preparations and auxiliary results 

3.1. Autoregressive representation for the covariance process. For any n, 

by the stationarity of Xk.n (^ = 0, 1, • • • , n), the distribution law of Xk+i.n^k.n is 
the same with A"i.„Aro,„. For any < / < A/, let C/^„ := E,Xk+i.nXk,n and it is 
easy to check that 

oo 

Cl.n = O'nEXln = E ^^nVo = (3.1) 
fc=0 

where C;*„ is defined in (1.2). In addition, let 

Zk,l,n = Xk+l,nXk,n — Cl^n, Uk,l,n = ^nX k+l-l^n^k+ ^nCk+lX k-l.n+ £,k+l^k — &n^S,0 ■ 

(3.2) 

We have the following autoregressive representation for the covariance process. 
Lemma 3.1. Under the above notions, for any n > I, we have 

Zk,l,n = On^k-l,l,n + Uk,l,m k = l,---,n — l, (3.3) 



and 



where 



il-ei)+ in-l){l-9l) ' ^'-^^ 



1 

Ul.n = J / , Uk.l,' 



k=l 



Proof. The proof of the lemma is easy, so omitted. □ 

Lemma 3.2. Under the assumptions of Theorem 2.1, for any < I < M and 

r > 0, we have 



y 1 1 TO ( V^-Wi\Zo.l,n - Zn-l.l,n\ . \ 

hm — logP — • — > r = — oo. 

n^oo bi \ bnVn-l / 
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Proof. For every n, from the stationarity of {Xk,n}o<k<n, we have 



\Zo.l,n — Zn-l.l,n\ > ^„ 

V 1 - . 



rhn\/n — I 



<4F Xi,, > 



rbn\/n — I 



2^/1^;' 

where the last incquahty follows from the well-known: 
Now since 



/ oo \2 

2 



\p— / \p— / \p— / p— 

and Markov's inequality, wc have for := (1 — ^n)^Q;, 



But by Jensen's inequality, 



0." < Eexp (1 - 0„) ^ - " ^"^ E = Ee"«o 

\ p=0 / p=0 



Summarizing the previous estimates we obtain 



which yields the desired result by using the assumption 

, - On? 

0,1 — > OO, > oo. 



□ 



3.2. Some properties of the sequence {?7fc,i.m,n}- For all n > 1, < Z < A/, 

l<fc<n-/, m> 2A/, set 

m-2 
3=0 

and 

Uk,l,m,n ~9nXk+l-l^m,n^k + Ck+lXk-l,m,nSn + Ck+l^k — ^'nE^O 
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For any n,l, it is easy to see that {Uk,i,m,n}i<k<n-i is a strictly stationary se- 
quence with m+Z-dependent structure. Furthermore, the sequence {Uk,i,m,n}i<k<n-i 
has the following properties. 

Proposition 3.1. i) For any < I < M, 1 < k < n — I, 

E{Uk,Lm,n)^0. (3.6) 

ii) Ifk^t, 

]E(?7fc,0,m,nC^i,0,m,ri) = 0. (3.7) 

iii) Ifl^O,k> i, 

Cm-l-2i \ 

Ui+ ^l^^A.j (3.8) 

where the sets Ai,A2 are defined by Ai — {i + I > k}, A2 — {i + 1 — k}. 

iv) If 1^0, 

mlun,n) = ( CeCo' + ( 1 - 2^ + 2 j {Eeof I . (3.9) 



v) 



(3.10) 



Proof. Without loss of generality, we can assume that i < k and for any fc, let 

J^k ■= ct(6; -oo <i<k). 

Proof of i) The claim (3.6) is easy to be obtained by the properties of conditional 
expectation. 

Proof of ii) Since E{Uk,o,m,n\J^k-i) ~ 0, and Uifi^m,n is measurable with respect 
to J-k~i, then we have 

E{Uk,0,m,nUifi^m,n) =E[Uifl^m,nE{Uk,0,m,n\J^k-l)] = 0. 

Proof of iii) Let 

m— 1 m— 1 

Ai,fc,i := ^ ^^iCfe+i-iCfe) ^2,k,i '■= ^ ^k+i^k^j^i- 
3=1 i=i 

then it is easy to check that Ui^i_rn,n is measurable with respect to J-k+i-i and 

E{Uk,l,m,n\J'k+l-l) = Ai,fc,i - elE^l 

So we have 

E{UkJ,m,nUi^tm,n) ~ E[Ut^i^rn,ni^l,k,l - ^nlE^o)] ~ E{Ui^i^rn,n^l,k,l) ■ 

Next wc need to calculate the following four terms: 

(1) E(Ai^fc,iAi,u), (2) E(Ai,fe,,A2,,,0, (3) E{A^,k.l^,+l^^), (4) E{A,,k,iKE^l 
First, wc can observe that 
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• when i + 1 > k, then there exists 1 < .7, 9 < m — 1 such that 

• when i + I = k, then there exists 1 < j, g < tti — 1 such that 

• when i + I = k, then there exists 1 < j < m — 1 such that 
Let Ai = {i + I > k}, A2 ^ {i + I = k}. Therefore, we have 

(m-l \ /m-l \ 

where we take j = I = q and use the fact that under the case i + I > k, we may 
choose j = k + l — i,q = i + l — k. Similarly, we have 

(m-l \ /m-l \ m-l-2i 



and 

From the above discussion and the definition of Ui^i^m.m the proof of iii) is com- 
pleted. 



Proofs of iv) and v) Since 



' 7n—l m— 1 



=:E(Ai + A2 + A3 + A4) 



2 



EAj = ■ 
E(AiA4) 

ml) = ■ 

E(AiA2) 
E(A3A4) 
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then it is easy to see 

E(AiA3) = E(A2A3) = E(A2A4) - 0, 

Ml)'E]1-i'o^^, 1 = 0, 

[0, 1 = 0, 

'mi)', 



ECo^ I = 0, 



0, 1^0 

Sni)'ET=i&l', 1 = 0, 

-mi)', 1 = 0- 

m—1 



EiAi) = e'^mi)"', ml) = mi)^ E ^^n, v o < ^ < m, 

which yields the desired results. 

Proposition 3.2. Let 1 <i < k and < l,q < M . 

(a) If 1^0, then E{Uifi^,n,nUk,l,m,n) = 0. 

(b) If 1^0, then 

+ J2 ol= 

where the events Ai,A2 are defined in Proposition 3.1. 

(c) IfO<l< q, then 

/ rn-l~(l+q) 
E(C/u,m,„C/fc,,,m,„) = C(Eeo)' + 



J=0 



(d) IfO<q< I, then 



3=0 

+9'-^mi)^ \^e, + ie, J2 

where the events Ei , E2 are defined by 

Ei = {i + l> k + q], E2 = {i + l = k + q}. 



Proof. The proofs of the proposition arc similar to the one of Proposition 
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Proof of (a) Since Ui.o^m.n is measurable with respect to J^i, then we have for 

i < k, 

,0,m,n .rn,n 



= 0. 



Proof of (b) Since i < k, 



E(C/fc,o,™,„f/M,m.n) i 2 ^ OP^k-p^k + ek - EC, 



' m— 1 



m— 1 



=:E(Ai + A2 + A3)(ri +T2 + Tg + r4), 
then it is easy to check that 

EAir4 = EAaFa = EAaF;:, = EA3r2 = EA3T3 = 

and 

EAaFi = EAaFi = 0lmof, EAzFi = EAaFi = -0lmo)^- 
Furthermore, we have 

• when k<i + l, then EAiTj = 26'5,(E^^)2; 

m—l — l 

• when k = i + l, then EAiFa = 2 ^ 6*1+2^ (E^o)^; 

• when k^i + l, then EAiFg = 26'J,(E^^)2. 

So the desired resuh (b) is obtained. 

Proof of (c) Since i < k and I < g, then Ui^i^m,n is measurable with respect to 
J'k+q-i- Hence we have 

,m.n Uk.n 



I. L.m. 71 



^j=i i=i / p=i 

By the similar discussions as (b), we have 



' m-1 

E 
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• when i + I = k, we have 

(m-l \ /m-1 \ m-l-((+9) 

i=i / \p=i / i=i 

• when i + / = fc, wc have 

• for the last term, 

-e[Ml^ (^E ^nWp^j = -e'+^mlf. 

From the above discussion, the proof of (c) is completed. 
Proof of (d) Since i < k and q < I, and 

{/m— 1 m — 1 

Cm— 1 m—1 
p=i p=i 

=:E(Ai + A2 + A3 + A4)(fi + fa + f;, + f4), 
then it is easy to see that 

EAif 3 = EA2f3 = EA3f 3 = EA4f3 = EA2f4 = EA3f4 = EA4f 2 = 

and 

EAif 4 = EA4f 1 = -EA4f 4 = -eJ+'CECo)^. 
In addition, we have 

EAifi=C(EC2)2(i + i^j, 

m-l-(i+g) 

J=l 

and 

Similarly, we can observe that 

• when i + I > k + q, then there exists 1 < j,q < m ~ 1 such that 

• when i + / = fc + q, then there exists 1 < <? < '^^ — 1 such that 

• when i + Z = fc + q, then there exists 1 < p < m — 1 such that 

Ete+ie.a+«a-p) + 0. 
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Hence we have 

m—l — {l—q) 

and 

Combining the above resuhs, we complete the proof of (d). 
Proposition 3.3. When i — k, we have 

(1) If < I < q, we have 

rn—l—{q—l) 

(2) IfO<q< I, we have 

rn~l~{l — q) 

(3) If I = q ^ 0, we have 



m— 1 



(4) lfq>0, we have 

m—l — q 

E(t/..o,™.„c/.,,,™.„) = eUM^) - eu^eof + ^iKQ^o'n E ^n'- 

Proof. From 

I /m— 1 m—1 



X 



/ m— 1 m—1 
\p=l p=l 

=:E(Ai + A2 + A3 + A4)(f 1 + fa + fg + f 4), 
we know that for any < l^q < M , 

EAif 2 = EAaf 1 = EAaf 3 = EA2f4 = EAgfa = EAaf 4 = EA4f2 = EA4f3 
EAif4 = EA4f 1 = -EA4f4 = -0i+9(E^^)2 
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and 

'e\-'>{nl?. l>q 

0, l<q' 

'ei-^iEa?, q>l 

0, q<l' 

'mi?E-L\'ol'. 1-1 

0, l^q' 



EAgfg 



0, g^/ 



So the results (l)-(3) hold. Furthermore, (4) can be obtamed by the following 
observation 

/ ra-l \ 

\ p=l / 

□ 

3.3. Moderate deviation for m-dependent sequence with unbounded m. 

Before giving our proofs of the main results, it is necessary to give the following 
moderate deviation principle for m-dependent random variables with unbounded 
m. For the readability of the paper, we postpone its proof to Appendix. 

Lemma 3.3. For each n = 1, 2, . . . , let m ^ m{n) be specified and suppose that 
{Xi_n, ■ ■ ■ ,Xn.n} be a sequence of strict stationary m-dependent random variables 
with zero means. Moreover, we assume the following conditions hold: 

(A) there exists a positive < 7 < 1 such that the moderate deviation scale (6„) 
satisfies 

bn -> 00, — > 0; 

(B) for some M > 0, 



n I ,™ / , , \/nx 



e"F |Xi,„| > ^ \dx 



b^m J M V ' 

(C) for any e > 0, 

(D) there exists a constant < cr^ < 00, such that 

lim m~'^Var{Xi^n + • • • + ^m.n) = 
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lim m-iy iE(Xi.„X,+i,„) = 0. 

i=l 

Then for any A G M, we have 

Furthermore, by the Gartner-Ellis theorem (see [4]), for any r > 0, we get 



lim -5- log P 



i=l 



> r 



Remark 3.1. In [3], Chen established the moderate deviation for jTi-dependent 
random vectors with fixed parameter m. Recently, Miao and Yang [13] proved 
the following moderate deviation, which extended Chen's result from fixed m to 
unbounded m for R-valucd m-dcpcndent sequence: 



that 



supEexp{a|Xi^„|} < 00, for some a > 



bn 00, 



0. 



(3.11) 
(3.12) 



In addition, if the condition (D) hold, then for any A G M, we have 



Jim - log E cxp (^A— ^ X..„ j = 



It is easy to see that the condition (3.11) and (3.12) imply the conditions (A). (B) 
and (C). But, the condition (3.11) is not easy to check in the process of proving 
our main results, so we need develop a new moderate deviation for m-dependent 
sequence with unbounded m, that is, Lemma 3.3. 



4. Proof of Theorem 2.1 

4.1. Asymptotic term and moderate deviations. We have the following useful 
results, based on the properties of the sequence {Uk,i.m,n\i<k<n-i- 

Corollary 4.1. Let m :~ m{n) denote the subsequence of n such that m{l — On) — > 
00 as n 00. Then we have 

lim i V fcE(C/i,i,™,„C/fc+i,z,™,„) = (4.1) 

n— >oo jji ^ — ^ 

k=l 

and 

lim i:i^l^ar((7i,,.„,„ + • • • + f/™.z,™.„) = 4(Eeo')'. (4.2) 

n— >-oo 771 
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Proof. Case I 0. From iii) in Proposition 3.1, it is easy to see 

1 _ 02 ™ 

lim -y^kE{Ui.l^m.7iUk+l.l.m.n) 

n— >oo 777, 



I, — ^rio 771 ' ^ 



k=l 
g2 ' 



n— >oo 777 



1 



fe=l 



= lim 

n— >oo 777 

= lim 1^ 

Ti— i-oo 777 

Furthermore, since 



,m.n Ul+l,L7n,7i) 

.k=l 

■ I m-1-2; 
.fe=l g=l 



= 0. 



m 771—1 m 

m rn—l k-\-l 

= E^^ta" + 2E E IE(;7fc,z,„,,„C/,,,™,„), 

fe=l fe=l i3=fe+l 

then, by iii) and iv) in Proposition 3.1, we have 

7n-l k+l / m-l-2l N 

E E ^(^M.™.nC/,.;,«MO=("i-O k^J.ECo^)' + (Eeo')' E 

k=l q=k+l \ 9=1 / 

and 

m II m — 1 \ 

EEf/,',z^„,,„ = m Uf/ECo" + ( 1 - 20'/ + 2 E ^" J (^^o)' 

Hence it follows that 

Var{Ui.i 

,m.n I + U,n,l.7n,7i) 

=m9l'E^^ + {m + [2{m - 1)1 - 2m]e-'^) {E^lf 

ni—1 m— 1 — 2/ \ 

27.E^"'+2(--o€ E 

3=1 i=i / 

By the assumption (1 — ^^„)m — > oo (which implies 6*™ 0), we have 
\ — 6^ 

lim -Var{Ui,i.,n.77 + ■■■ + = 4(Eeo)^ 

n->oo 777 ■ 

Case I = 0. From ii) in Proposition 3.1, we have 

q2 



and 



1 _ 

lim ^E^^e^l.O.Ti.n^fc+l.O.m.ri) = 

n— »oo 777, — ^ 
k=l 

771 

Var{Ui,o^ra.n H (- f/m,0,m,n) = E ^^^^fc.O.m.i 
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By v) in Proposition 3.1, it follows that 
then we have 



(4.3) 



1 



lim 

n— )-oo rn 



'-Var{Uij^rn,n + • • • + Um.l.m.n) = ^^^of 



□ 



Before giving the fohowing proposition, we need to mention the claim: owing 
to the conditions 



n(l — On) oo and 



there must exist a subsequence m — m{n) such that 



0, 



to(1 - 6'„) ^ oo, - — -4-7 ^ oo and -= > 0. (4.4) 



log(l-0„)| 



For instance, we can take 



m = (1 - 0„)-<'/^ 
Now, based on the above preparations, we have the following result. 
Proposition 4.1. Under the assumptions of Theorem 2.1, for any A G M, we have 



lim -i- logEcxp I A ^"^^i_^" ^ C/fe,,,„,„ ^ - 2A2(Eeo')', < / < A/, 



hi 



k=l 



where the sequence {m} satisfies the properties in (4-4)- Furthermore, for any 
r > 0, 



bnVn~~l 



n—l 



k=l 



> r \ = 



2\2 ' 



0<l< M. 



Proof Set 

then it is easy to see that 
lim el 

n—)-oo 

For every < Z < M, let 



lim6'2™ = and lim (1 - 6',2)/ir,„(6'„) = 2. 

n—)-oo n— ^oo 



(4.5) 



then by the properties of !7i,i,m,n, we have 

lim = 4(Eeo')2, and lim EX2,,„ = 2(EC2)2, ? ^ 0. 

n— >-cxD n— >-oo 

Furthermore, from Corollary 4.1, for any < ' < M, it follows that 



1 



2n2 



lim -Var{Xi,i^„ + ■■■+ X„,.(,„) = 4(EeS) 



(4.6) 
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and 



^ m 

lim - V kE{Xi,i,nXk+i,i.n) = 0. (4.7) 

n->-oo m ^ — ' 
fc=l 

Next, we need to check the conditions (B) and (C) of Lemma 3.3 for the random 
variable Xi^i^n, namely, for any M > 0, 

r e-P f |Xi,,,„| > ^) dx ^ (4.8) 

and for any e > 0, 

where we take 7 — 2/3. However, from the definition of Xi^i^^^ 

■m— 1 m— 1 

. i=i j=i 



it is enough to show that (4.8) and (4.9) hold for the term ^1 — 6'^ X^JLi '^n^i+i-jCi; 
and the proofs of the others are similar. By the conditions 

m[l-el)^oo and ^ 0, 

we know that for all n sufficient large 

5„m ^ 6„to3/2 V 

From Cauchy-Schwarz's inequality, we have 

<Ecxp<|^^(i^'£^^,(c?^,_^. + eD 



< I^Ecxp I ^^ii^ 5: I j I^Eexp I ^ie, 

<Eexp j^^i^i^™(0„)^A < Ee"«?, 
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SO, for any A/ > 0, 



bh 



M 



(1 ~ 0i) 0^,a+/-.a 



> 



<- 



«(i - el) 



M 



1/10 



i=i 









L ^^^^ 




[(f) 







1/10 



x>dx^O. 



In addition, from the fact that 



we have, for any e > 

- 16/5 



bn 



< 



bn 



16/5 



bn 



(V^/&„)-3/10 

Tn— 1 

(1 - oi) ^^.a+;-,a 
(1- 



i=i 

m— 1 



16/5 



i=i 

1/10 



> e 



> e 



2/5 



1/10 ' 



(4.11) 



exp < — e 



bn 



0. 



Therefore, the conditions in Lemma 3.3 are satisfied and the desired results of the 
proposition can be obtained. □ 



4.2. Exponential approximation. In this subsection, wc shall estabhsh the as- 

ymptotic negligibility of the term ^^^^"i Y^lZi{Uk,i,ni,n - Uk,i,n) as n -)■ oo. For 
all p > and fc > 1 , set 

Wk^p = Ckik-p- (4.12) 



Lemma 4.1. Let the assumptions of Proposition 4-1 hold. 

(1) There exist and /3o such that for all p > 1, n > 1 and t > 



max 



fe=i 



> t ] < 36 cxp 



t' 



a^n + Pot 



(4.13) 



(2) For all t > 0, there exist N > 1, A,B > such that, for all n > N and 
0<l < M, 



max 

j<n-l 



<72 1 - exp 



'Y^iUk,l,m,n — UkJ,n] 

blt^ 



k=l 



> tb„ 



\Jn — I 

\ \ -1 



2 j-2 



bit 



{At + B)Kne^^,/i~ei 



exp 



{At + B)Knei-^Y^^) 
(4.14) 
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where Kn ^ {I - On) ^ and Kn&'^^X as n -> oo. 

(3) For all t > 0, 

n—l 



lim 7^ log 



bnVn - I 



^(t^fc,/,in,n — Uk,l,n) 



fe=l 



>t\= -oo. 



Proof. (1) This is Lemma 17 in [11]. 
(2) Firstly, we have 



k=l 



< 



k=l 



OnS,k[Xk+i-l^n — -^fc+/-l,m,n) 
3 



k=l 



Since 



we can get 



p=0 



fc=l 



oo 
p=0 



fc=l 



Now it is not difficult to show the fact: for any n > 1, 

oo 

Hence, by (4.13), we have 



max 

l<j<n-l 



On£,k{Xk+l-l,n — Xk+l^ljn,n) 



k=l 



> tbr, 



\Jn — I 



(4.15) 



<p(y(p+i)^ 



oo / 
p=0 \ 



max 

<j<n-l 



max 

<j<n-l 



<36 E^ exp 

p=0 

where 



By noting that 



k=l 

b'^t^ (t) 



> 



tb.n{p + iWn - ; 



ao + P[)tni,p[t)bn I \fn~~l 



(4.16) 



i(p+l) 



2i^„0,™yi^ 



m(l - g„) 
|log(l-0„)| 



oo =^ hm i^„C V'l~~02 = 
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and from the assumption of 5„, there exist constants N ^ A, B > 0, such that 
for all n > N, I > 0, and we obtain 



> c{t)- 



P+l 



Hence, by (4.16) and (4.17), we get 
/ i 



c{t) 



At + B' 



max 

l<j"<n-Z 



fc=l 



> tb„ 



<36^cxp -62c(t) 
p=0 \ 

=36 1 — exp 



P+l 



blc{t) 



exp 



bldt) 



(4.17) 



(4.18) 



For the same reason, we can give the estimate of the second term in (4.15), so the 
proof of (4.14) can be completed.. 



(3) It follows obviously by (4.14). 



□ 



At last, the proof of Theorem 2.1 can be completed by Lemma 3.1, Proposition 
4.1 and (3) in Lemma 4.1. 



5. Proof of Theorem 2.2 



Let Ykj^n = Xk+i,nXk,n-'^Xk+t,nXk,n for any 1 < k <n and < / < M. Since 

M n-l n~M M M-1 n-l 

1=0 k=l k=l 1=0 1=0 k=n-M+l 

then the desired result is equivalent to showing 

n-M M \ 
ai,nYk,l,n > r 



hm — log 

n->oo tli. 



bri\/n 



k=l 1=0 



(5.1) 



and 



lim T^log 

n—^oo 0^ 



bn\/n 



A/-1 n-l \ 

ai,nyk,i,n >r\= -oo. (5.3) 

;=0 k=n-M+l / 

As the similar proof of Theorem 2.1, in order to obtain (5.2), it is enough to show 
that for any A £ M, it follows 



ylogEcxp-^A -= 2^ y ^ai.nUk.l,m.n > 

'» I k=l 1=0 J 

where the sequence {m} satisfies the properties in (4.4). Let 



^™ 1,2 

n— >-oo 



M 



(5.4) 



(5.5) 
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then it is easy to see that {Yfc,m.n}i<fc<n-M is a strictly stationary sequence with 
m + A/-dependent structure. Hence from Lemma 3.3, (5.4) is equivalent to proving 

1 _ fl2 ™ 

lim ^ V m{Yl.,n,nYk+l.m,n) = (5.6) 

n— foo TJl — 
k=l 

and 

1 _ fl2 



lim ^yar(Yi,„,„ + • • • + = S^. (5.7) 

n— i-oo m 



For i < k, we have 

Yi ,nYk .m ,n — ^o,n^?,0,m,nt^A:,0,m,n ^ I ^ ^ ^ ^nU i .1 ^ra .71 J | ^ ^q,nUk.q.ni,n J 

\i=l / \g=l / 

A/ J\f 

1=1 9=1 

From (3.7) and Proposition 3.2, it follows that 

/ M \ 

0, E ^ [/,; 

,0,m,n 

Vg=l / 

and 

i=l / i=l \ 3=0 

Since i < and 

I E Ui^ljn,n I I ^ C/fc,g 
Vi = l / \<Z=1 / 

(A/-1 M AI-1 A/ \ M 

^ ^ ^ ^ ^ ^ ^ ^ ^ I Ui^l^')n,7iUk^q^m,n -i" ^ ^ Ui,l,m,nUkJ,m,n^ 
1 = 1 q=l+l q=l l=q+l) 1=1 

then by (3.8) and Proposition 3.2, we have 

M M / m-l~2l \ 

Y^iUu,n,nUkJ,m^n) - ^ ^?''(lEeo)' + ^ , 

1=1 1=1 \ q=0 J 

M-1 M 

1=1 q=l+l 

AI-1 J^I ( ( m-l-(i+g) 

= E E e^(ECo^)Mu. + u. E ^ 

1 = 1 q=l+l \ \ J=0 
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and 

M-l M 

q=l l=q+l 

M-l M I m-l-{l^q) 

J2 ciEegf u. + u. E ^n^' 

9=1 i=9+l \ J=0 

M-l J\f / m-l-(;-g) 

q=l l=q+l \ J=0 

Hence we can obtain 

M / rn-l-l 

=2(Eeo')'ao,„E«'.«^« 1^1+1-42 E ^" 
i=i V i=o 

M I m-l-2l \ 

;=i \ g=o / 

A/-1 M / m-l-(i+g) 

+ mo f E E + E I (5-8) 

1=1 q=l+l \ j=0 

M-l M ( m-l-(;+g) 

+ (K^O)' E E «'.n«9."^^' + E ' 

g=l l=q+l \ j=0 

M-l M / m-l-{l-q) 

+ i^^o f E E + E 

q=l l=q+l \ 3=0 

= 'IlA.k.n + h.i-k.n + h.i.k.n + h.i.k.n + hs,k,n- 

Furthermore, since 

M / M \ ' 

i=l \i = l / 



and 



^ J\/ \ ^ /M-l M M-l M 

^ ^ ^ ^nU i .1 ^ra .71 J | ^ ^ ^ ^ ^ ^ ^ ^ ^ 1 ^l.ji^q^nUi^l.nijnUi^q^m^n 

\l=l ) \ 1=1 q=l\l q=l l=q+l) 

M 



/2 

i.l.m.ni 



1^1 
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then from Proposition 3.1 and Proposition 3.3, we have 



M 



1=1 

M-1 M 

1=1 q=l + l 
M-1 M 

q=l l=q+l 
M 



m-~l — {q—l) 

7n—l—{l — q) 
p=0 



(5.9) 

Now we prove the relations (5.6) and (5.7). From (5.8), in order to show (5.6), 
we only prove the following claim 

lim fc/i,i,fc+i,n 



n— )-oo m 



k=l 



1 n2 / m — 1 — Z \ 

2(E^2)2 ^.^^ y-fcVaz.n^i V =0 



(5.10) 



J=0 



and the proofs of other terms are similar. In fact, by the definitions of Ai,A2, we 
have 



M 



-l-l 



k=l 1 = 1 



j=0 



M M+1 M 

1=1 k=l 1=1 \ j=0 

which implies (5.10). Next we prove (5.7). Since 

m 771—1 ni 

Var{Yi 

.771. n ,711.71 



then from (5.9), wc have 

I -el 



lim 



n— i-oo rn 



k=l 



2 

k,ra,n 



i=l k=i+l 



k=l 
M 



M-1 M M 

Aal + 4ao E + 2 E E + 2 E «M (^^o )' 

1=1 1=1 q=l+l 1=1 
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Moreover, by (5.8), we have 

q2 m—l m 



— ~ y. y. h.i,k,n 

i=l k=i+l 

1 /i2 '"■ — / /ft— i- — t 



m — 1 



(=1 



1=1 



M 



^2(Eeo')'aoE«'- 
Similarly, we have 

r.2 rn—1 m 



1 



M 



771 



^E E /2.,.,„^(Ee„^f E«'' 

A/-1 A/ 

(ECo')' E E 
i-^ E E ^4,..,. ^ m'of E E 



m — l m 



1 a2 ™-i ™ 



i=l k=i+l 
„2 "i-l m 



i=l k=i+l 



q=l l=q+l 
A/-1 A/ 



a/a,. 



i=l fc=i+l 



q=l l=q+l 



SO, it follows that 



1 /32 ^ 



n— >oo rn 



j;=l fe=i+i 

A/ A/-1 M 



Hni? 2aoE«' + E E 

From the above discussion, we have 



lim -Var{Yi^rn,n 



/ M 

E' 

\q=\- 



M 



n~¥oo m 



^m,m,„) = 4 I E^j I (E^o)'- 



At last, we need to show (5.3). Since for any r > 0, we have 



y bnVn 

M-l n-l 

^E E 1 

l=Q fe=n-A/+l 



A/-1 n-l 



E E (^l,nYk,l,n 
1=0 fe=n-A/+l 

(1-02)3/2 



> r 



6„a/77 



\a.l,nykd,n\ > 



2r 



M(A/ + 1) 



then from the stationarity of Ykj^nik = 0, 1, • • • ,n ^ I) and the fact that for any 
|a/,n| < Ni for some iV; > 0, it is enough to show that for any Q <l < M , 



lim — log 

n->oo bt 



bnVn 



\Yk,Ln\ > 



2r 

NiM{M + 1) 



(5.11) 
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However, from the definition of Ykj,n and the fact that E(Xi^„Xo,„) — 9l^{l 
el)-^E^^, we have 

hm llogP('ii-4£^|FM.«l> 



bl ^ \ bn^ ' - NiMiM + 1) 

< Urn 7T logF ^ , "Z |Xi.„Xo,„ - E{Xu,Xo^n)\ > 



?l— >-CX3 



n— >-oo 



n—>-oo 



(1- 


^2)3/2 




\/n 




9^)3/2 


fen 




(1- 


^2)3/2 


b„ 




(1- 




fe„ 





7V/Af (A/ + 1) 



< hm ^ logP ( , ""i \Xu.Xo,n\ > 



62 ^ V fenV^ " iV,A/(A/ + l) 



Here the last hmit is due to the similar proof in Lemma 3.2 



6. Proof of Proposition 2.1 



The proof of Proposition 2.1 stems from the method of Theorem 2.2. From the 
definition of 0„ , we have 

;{6n — On) 



"bn{\-eiyi^ ELi^Li.. 

(i-e?J(Eeo^)-iiELi^Li,„ 



R„ 



Let us first prove that (i?„ — 1) is negligible with respect to the moderate deviation 
principle, i.e., to show that for any r > 0, 



Jini_^logP((l-&2)(Ee2)-ii 



k=l 

where we use the fact EXl_^^^ = ^X^n = (1 - e'ly^EH. Since 



> r = — cxD, (6.1) 



{i-el){Ml)-\ 



fe=i 



> r 



b„\/n 



fc=i 



> 



6« 



then by the condition (3) (which implies \/n{l — 0'l^)b^^ — > oo) and Theorem 2.1 
yields (6.1). Next we only need to prove that r„ satisfies the moderate deviation 
principle. Let 

ao.n = ~{l-Ol)-\E(^)-'en and ai,n = (l - dly' mo)~\ 

then 



y/nbn 



1=0 k=0 
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Since ao,n — >■ — oo, ai,n — > oo, then we can not use directly Theorem 2.2 to prove 
the moderate deviation of r„ . So we need to shghtly modify the proof of Theorem 
2.2. 



Now rewrite r„ as 



(1 — 02^1/2 " °° 



1 " 



k=l 



Let TO be a increasing sequence satisfying the properties in (4.4) and put 



(^l „ 6)2)1/2 ™-l 
p=0 



mi) 



then {Xic is a strictly stationary sequence with TO-dependent structure. 
Lemma 6.1. For any r > 0, we have 



lim -i- log I 



1 



bn\/n 



k=l 



> r \ = . 

2 



Proof. In order to obtain the desired result, it is enough to check the conditions in 
Lemma 3.3. Firstly, it is easy to see that 

lim „ = 1 

n—>oo 

and for any k j, 
Hence we have 

lim —Var{Xi jn,n H K ^m,m,rO = 1 

n— i-oo m 

and 

^ rn 

lim — V'iE(Xi.„,„Xi+i.„,„) = 0. 

n->-oo m ^ — ' 
i=l 

Moreover, by using the similar proofs of (4.8) and (4.9), the conditions (B) and (C) 
in Lemma 3.3 hold. So we complete the proof by using Lemma 3.3. □ 



Lemma 6.2. For any r > 0, we have 
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Proof. Since for any < j < n, 



^(i'fc,m,n - Xk,n) = Jw^) 51 X! 0^£,k-l-p£,k 

k=l ^ '^0' k=lp=m 

y^^o) k=lp=0 
(1 — f?,^)^/-^ °° 



mi) 



0=0 k=l 



where Wk,m+p+i is defined in (4.12), then by the same proof of Lemma 4.1, the 
desired result can be obtained. □ 

At last. Proposition 2.1 can be given by using Lemma 6.1 and 6.2. 



7. Appendix 
Proof of Lemma 3.3. For each n, let 

m 

where / := l{n) = max{j : jm < n}, then {Yi^n, ■ ■ ■ ,Yi,n} sue 1-dependent random 
variables. Furthermore, take p = p{n), such that 



p[n) — > oo and ^ > v, as n — cx) 



(7.1) 



and define 

(h-l)p<j<hp 

where t :~ t{n) = maxj/i, /ip < /}, then {Zi_„, . . . , Zt_„} is an i.i.d. random se- 
quence, and we have the following relations 

n / n 

^ ^ A^2,7l ^ ^ YjjU ^ ^ ^ -^ijU 

i=l j=l i=lm+l 

t I t n \ ■ ) 

= 5^ Zh^n + 5^ Yj,n + 5^ ^/tp,ri + ^i,n- 
/i— 1 j=tp+l /i — 1 i— /?n+l 

Lemma 7.1. Under the assumptions of Lemma 3.3, for any A G M, liie /lawe 



lim -i- logEexp ( A-^ Z,, 



2^2 



i.e., for any 7' > 



lim IT log I 



b„.\/n 



> r = 



2 ' 



2ct2- 
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Proof. For r > 0, define 

Til 

and 

(;i-i)p<j<ftp 

where t are defined in tlic above notations. Now we divide tlie proof into tlie 
following two steps. 

Step 1. We claim that for any ?- > 



1 . „ / 1 



lim To" log I 



h=l 



>r (7.3) 



Since {Zl ^, . . . , is an i.i.d. random sequence, then for A G 

1 logEexp f A-^ ^h.n] = ^ logEexp f A-^Z[,„ 



First from the conditions (A), (B), (C) and Fubini Theorem, we have 



n If bnin \ ^ 



2?T- /""^ ™ /, , \/nx , , \Ai\ . 



52 



52 m 7^„j V ' 6„m / 6,2 TO 7o V ' b„ 



where we utilized the fact: for all sufficiently large n, 



TO < 



bn 
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Noting that EXi,„ = and the fact (tmp)/n — > 1, we have, by (7.4), 
From the definition of we have 

p-2 p-l 

j=l 

p-2 p-3 p-l 

Since the estimate (7.4) imphes 

771 

1 

777 



<777E ( Xf , 



•^{|x,,„|>.^}+---+^".«^{|x„,„|>.^} 
then we have 

777 

where we used the condition (D) and the triangle inequality in the spaces: 

||yi:j|2 < - Yl,nh + \\Yl,nh, ||yi,„|l2 < Hl^n " ^l^nlb + WY^Jh- 

So we have 

77 ' 77 777 

Similarly, we have 

m 

- 5]7E|(X[,„ - ^l,n)(X,^l,„ - X.+ i,„)| 
i=l 



777 + 1 / o \ 

-^7E|(X[^„-Xi,„)X,+i,„| 

777, ^ — ' 

i=l 

<(m + l)E (xU||^^ „|>,^|)^0, 



(7.5) 



(7.6) 
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and 

^ ra 

- 5]zE|(X7+i.„ - X,+i,„)Xi,„| ^ 0, 



m 

i=l 



from which we can deduce 

^ m 

i=l 
^ m 

= — y i E(Xi,„Xi+i „) + E(XJ" — Xi_n){XLi — Xi^i n) 

777 Z ^ L 111 

= 1 



m 

i=l 



Hence we can get 



n 



A^ifn— 2)m I 1 -J^ ^ ^ ^ 1 mini — 1) ^ 

z — ^ ' ' ' m ' 



m 

i = l 



and 



where we used the condition (7.1) and the fact that 



So we have 

— E(zr,j2^AV^ 
n 

Furthermore, for any £ > 0, we have for ah n sufficient large, 



7,3/2 



n 



<£^E|zr,,i» + :!i!^!=!s!p/|x,,.j>.-^^ 



'n 



n n o„ 1^ Onmp 

V fen 



where we used the condition 



< — E|zr,j^ + -\^\ p ixi,„i>£ 

n n 



6„(mp)i+T^ ^ mp 

hm ^ = lim , ^ ,, ,,,,,, , = 0. 
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Therefore, by noting mpt/n — > 1 and the arbitrariness of e, we have, from the 
relation (7.8) and the condition (C), 

Hence from the above discussions, we have 

which yields, by the Gartner-Ellis theorem, for any r > 

t 



lim i-logpf -i^ 



> r \ = 



Step 2. Wc shall prove that for any r > and r > 

t 



1 , ™ / 1 

hm -logP 



h=l 



> r = — oo. 



Let [a] denote the integral part of a, then for any A > 0, 

t \ 



-^logpf-^ 



h=l 



> r 



< - rA + 1 logEexp ^ |Z^^„ - Z,.„| j 

< - rA + 1 logEexp g " ^^-l j 



, , , ^, [(p-l)/2] 

<-rA+^iog(Eexp|2^ ^ |y4„ - 



1/2 



2j,n I 
1/2 



2^ X! I^2j-l,n ~ ^2i-l. 



X lliexp 



where 



[{p — l)/2] if p — 1 is even 

[(p-l)/2] + l ifp-lisodd. 



(7.9) 



(7.10) 
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By the definitions of Yj^^, Yi^„ and the elementary inequality logx < x — 1 for all 
a; > 0, then we have 

t{p-l ) . „ ^^XK 
2bl 



logEcxp 2^ yi^„-yi, 



tp 



Xbr, m 



<:&(e"'-l)rf|.V„l>.#V|^ 



< 



tp 

>0 



M 



\Xl.n\ > 



2A&„m 



dx 



\Xl,n\ > 



Inx 



dx 



where we used (7.4) and the condition (B). Thus the desired result follows from 
(7.10) and the arbitrariness of A. □ 



Lemma 7.2. Under the assumptions of Lemma 3.3, for any r > 0, we have 

I t n 



1 



lim Trlogl 

n— >-oo o 



1 



bn\/n 



j=tp+i 



h=l 



i—lm+l 



> r \ = — oo. 



Proof. Taking along the lines of the proof of Lemma 7.1, wc can prove that anyone 
of the following three terms 

It n 
^ ^ ^ ^ Yfip^n and ^ ^ ^i,n 

j—tp+1 h—1 i—lm+1 

can be negligible with respect to the moderate deviation principle. □ 



At last, based on Lemma 7.1 and Lemma 7.2, the proof of Lemma 3.3 can be 
finished. □ 
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